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1. Introduction 


In most physical phenomena, changes in spatial or temporal structure occur over 
a wide range of scales. Images are no exception: changes in light intensity reflect 
the many spatial scales at which visible surfaces are organized. It seems intuitive 
that a great deal of information can be gained by an analysis of the changes in 
a signal at different scales. For instance, graphs of one-dimensional functions are 
a very effective tool for describing complex systems. An important reason is that 
they allow direct visual access to important properties of the data, chiefly to their 
changes over different scales. 


The idea of scale is critical for a symbolic description of the significant changes 
in images or other types of signals. Changes must be detected at different levels 
of detail and over different extents. In general different physical processes may 
be associated with a characteristic behaviour across different scales. In an image, 
changes of intensity take place at many spatial scales depending on their physical 
origin. A multiscale analysis, tracing the behaviour of some feature of the signal 
across scales, can reveal precious information about the nature of the underlying 
physical process. In images, for instance, spatial coincidence at all scales of zero- 
crossings in the Laplacian of the intensity values filtered with a gaussian mask, 
signals a physical “edge", distinct from surface markings or shadows. Not only 
is it necessary to detect and describe changes in a signal at different scales, but 
in addition, much useful information can be obtained by combining descriptions 
across scales. 


The importance of this idea has been clearly realized in the field of vision. One 
of the main contributions of visual psychophysics in the last 10 years was indeed 
to show that visual information is processed in parallel by a number (perhaps a 
continuum) of spatial-frequency-tuned channels (Campbell & Robson, 1968). The 
bulk of the data demonstrates that the visual system analyses the image at different 
resolutions. Physiological experiments are consistent with the psychophysics. They 
suggest that in the visual pathway spatial filters of different size operate at the same 
location. Furthermore, psychophysics, physiology and anatomy all show that the 
spatial grain of analysis continuously changes from foveal to peripheral locations. 
Receptive and dendritic field sizes of both retinal and cortical neurons increases 
monotonically with eccentricity, in agreement with the dependency on eccentricity 
of the psychophysical channels. 


In the field of computer vision, Rosenfeld was one of the first to propose explicitly 
an edge detection scheme-based on multiscale analysis performed with filters of 
different sizes (Rosenfeld and Thurston, 1971). A similar algorithm was suggested 
by Marr (1976) though with different goals and motivations. More recently, he 
has strongly advocated the use of derivatives of gaussian-shaped filters of different 
sizes with the goal of detecting changes in intensity at different scales (Marr, 1982). 
The idea was first proposed in the context of a theory of stereomatching (Marr 
and Poggio, 1979). In that scheme, analysis at the different scales was effectively 
kept separate. Later. Marr and Hildreth (1980) proposed some heuristical rules to 
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combine information from the different channels. However, the important problem 
of how to combine effectively the different scales of analysis at thisn early level has 
remained open , although recent work by D. Terzopoulos (1982) has successfully- 
applied multi-level algorithms to the problem of reconstructing visual surfaces (see 
also the work by Richards et ah, 1982 and by Canny, 1983 on edge detection). In 
a recent conference (Cold Spring Harbour, April 1983) we learned from A. Wilkin 
a new way of describing zero-crossings across scale. 1 


A 1-dimensional signal is smoothed by convolution with a small (large) gaussian 
filter and the zeros of the second derivative are localized and followed as the 
size of the filter increases (decreases). This procedure originates a plot of the 
zero contours in the x — o plane (where a measures the size of the gaussian 
filter). 2 In this way, Witkin was able to classify and label zero-crossings achieving 
an effective description of a signal for purposes of recognition and registration. 
This is possible mainly because the geometry of the zero contours is surprisingly 
simple. Zero-contours are either lines from small to very large scale or closed, 
bowl-like shapes. Zero-crossings are never created as the scale increases. Witkin 
mentioned the striking result (obtained by .1. Babaud) that the gaussian filter is 
the only filter with this remarkable property in 1-D (at the same conference J. 
Koenderink told us that he has obtained similar results exploiting properties of 
the diffusion equation). 3 

We have now succeded in obtaining a proof of this result in 2D (and in fact 
any number of dimensions). We have also obtained related results for zero- and 
level-crossings of other differential operators, in particular for ridges and ravines 
in the image intensity. 


The 2-D result seems important because it: 

(a) lays the necessary mathematical foundation for using multiresolution labels for 
classifying zero-crossings for a symbolic description of intensity changes. 

(b) justifies the use of gaussian filters and an associated linear derivative because 
of their “nice" properties under changes in scale. 

In this paper, we will first state and prove the one-dimensional result. We will then 
show that only a specific 2-D extension is valid. Zero-crossing of linear derivatives 
have the "nice scaling behaviour" if and only if the image is filtered by a 2-D 
rotationally symmetric gaussian. In particular, the laplacian-of- a-gaussian filter 
suggested by Mart and Hildreth has nice scaling behaviour. The second directional 
derivative along the gradient, however, does not: no filter exists that can ensure a 
nice scaling behaviour of the zeros of this derivative. We have then, the following 
results: 


1 Witkin’s prize-winning paper will appear in the 1983 IJCA1 Proceedings (Witkin, 1983). We 
received a preprint after this memo went to press. 

2 J. Stansfield first described — for analysing commodities trends (Stansfield, 1980) — the idea of 
plotting zero-crossings over scale, but did not develop it. 

3 After completion of this memo we were informed that a technical report containing the ID proof 
is now ready, with the title “Uniqueness of the gaussian kernel for scale-space filtering,” by J. 
Babaud, A. Witkin and R. Duda, Fairchild TR 645, Flair 22). 
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(a) lor linear derivative operations- in particular, for the laplacian the gaussum 
is the only filter with a nice settling behaviour. 

(b) for the nonlinear directional derivative, no filter will give nice scaling behaviour. 

2. Assumptions and results 

We will consider filtering the image I with a suitable filter F ' and then consider 
the behaviour of the zero crossings as we change the scale of the filter We make 
five assumptions about the filter, and impose them as boundary conditions. 

(1) Filtering is shift-invariant and, hence, a convolution. We write this as 


F * I(x) = J F{x — i)I{i)d£- 


,2) The filter has no preferred scale length. In two dimensions standard results 

or dimensional analysis (Bridgman, 1922) give F(x,o) = ... /!-)• ° lhe 

seafe of The filter. The factor £ ensures that the filter is properly normalized at 

all 


clll scaiuo. _ , 

(3) The filter recovers the whole image at sufficiently small scales This is expressed 
by Lim a „o,F[x,o) = 6{x), where S(x) denotes the Dirac delta function. 

(4) The position of the centre of the filter is independent of a. Otherwise, zcio 
crossings of a step edge would change their position with change of sea e. 

(5) The filter goes to zero as \x\ oo and as <r >-> oo. 

Ac w m become apparent, our results are independent of scaling the x axis. We 
usually require that we scale this axis so that the filter is radially symmetric, and 
state theorems with respect to such axes. However, we can relax this reqin.ement 

by rescaling the axes. 

Hicure (1) shows the typical scaling behaviour of zero crossings in one dimension 
observed bv Wilkin. Figure (2) shows possible behaviour of zero crossings which 
is never empirically observed when the filter is a Gaussian. Hie generic properties 
of die zeSSngs curves in the *,* plane can be derived from the Implicit 
Function 'TTmorem To yield a C r curve the llieorem requires that the Laplacian of 
J™ "isc° ,«r,» lhe litter must be reasonably smooth Observe 

JVS «hh . sanssia. will ensure a C~ output for all ,n» 8 es because o 
the equivalence with the Cauchy problem lor the diffusion equation. The Implic 
Function Theorem may break'down at degenerate critical points when all first 
derivatives of the filtered image vanish together with the Hessian. Ihtsc pom s 
"Srt in lhe tense that a sutah petunbauon bill ties,to, them. Ob» 
that "true" zero-crossings can only disappear in pairs in the x,a plants Only trivial 
SIS do nol cross zero can disappear by themselves. They are, however, non 

generic. 

In one-dimension, the zero crossings obey 
1 Zeros of the Hessian correspond to zeros of the gaussian cuivaturc. 
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( 2 . 1 ) 


This equation gives x as an implicit function of a , i.e„ x = x(a). If we vary x and 
a so that (2.1) is still satisfied, we obtain 

dx = roc(^)/'"(^)w {22) 

^ I-oo /"'( V) W 

So the tangent to the curve is uniquely defined at a point, as are all the higher 
order derivatives. This prevents the behaviour shown in Figures 2b, 2c with the 
possible exception of the nongeneric cases, when the Implicit Function Theorem 

breaks down. 

The curve in Figure 2(a) is more interesting because it corresponds to a pair 
of zero crossings being “created” as the scale increases. The Implicit Function 
Theorem does not rule out this case. It therefore seems natural to require a filter 
such that this never occurs. In the following three sections, we will prove some 
theorems shoeing that such a filter can only be a gaussian and, moreover, that not 
all differentia! zero-crossings operators can obey this property. More precisely, we 

prove: 

Theorem 1. lh one-dimension, with the second derivative, the gaussian is the only 
filter—obeying our five boundary conditions—which never creates zero crossings 

as the scale increases. 

Theorem 2. In two-dimensions, with the laplacian operator, the gaussian is the 
only filter obeying the boundary conditions which never create zero ciossings as 

the scale increases. 

Theorem 3. In two-dimensions, with the directional derivative along the gradient, 
there is no filter obeying the boundary conditions which never creates zero ciossing 

as the scale increases. 

In section (5), we show that results similar to Theorems 1 and 2 can be extended to 
all linear differential operators (in particular, directional derivatives) and therefore 
to other features of the image, such as ravines and ridges (but not peaks) in the 
image intensity. These theorems can be extended to any dimension, but we will 

not give these extensions here. 

It should be emphasized that, although zero crossings can only annihilate themselves 
in pairs, the: intensity change corresponding to a zero crossing could become 
arbitrarily stfialler as sigma increases. The zero crossing would then become so 
weak that for practical purposes the curve may terminate. 

3. The 1-D case 

Let the image be I and the filter be F. We consider the zero crossings in the 
filtered image. 
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(3.1) 


Denote £^{F 4 


Tliese form cu 
created at large 
minima. Hence 

Let t be a par 


On a curve off 
choose the pa 
obtain: 


This result van 


/ oo 

F{x - ?)/({)<*£ 

-oo 

I) by E. Hence the zero crossings are the solutions of 

E(x) = 0. 


(3.2) 


•ves in the x — a plane. The condition that zero crossings are not 
r scales is that for all such curves a{x) the extrema of <r(z) are not 
, for all points x 0 such that tr'(x 0 ) = 0, we require that a"(x 0 ) < 0 . 

meter along a curve in a — x space. Then 


dE __ dE_dx dEda 
dt dx dt da dt 


(3.3) 


zero crossings, E = 0, and so = 0 on such a curve. We can 
[Jameter t to be x. Then, using the Implicit Function Theorem, we 


da — E x 
dx E a 


(3.4) 


ishes at x Q if and only if 


and we calculate 


Ex{%o) — bj 


(3.5) 


d 2 a{x 0 ) __ — E xx (x 0 ) 
dx 2 E 0 (x 0 ) 


(3.6) 


Tlius, our filter must be such that if 


then 


The Diffusion 


E(x 0 ) - E x (x 0 ) = 0 


(3.7) 


E xx (x 0 ) 

Ea{Xo) 

Equation can be written as 


> 0 . 


(3.8) 


d*E 1 dE 
dx 2 a da 


(3.9) 
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Note that by 
If the filter F 


tie substitution t 
> a gaussian. 


then it will o 
hence E(x) wi 
will always sa 

We now show 
obeys the bou 

Consider an i 


t ey 

il 

tify 


the diffusion equation of which it is the Green function and 
|l also obey the equation. Thus, = \ and so a gaussian filter 
conditions (3.7) and (3.8). 

(that the gaussian is the only filter which satisfies the conditions and 
dary conditions specified in section (1). 

age which is the sum of delta functions: 


ri 


It is possible tp generate any image in this way by taking the limit asrinoo. 
Set 


Equations (3.1 


and 


We can consfl 
for any z 0 , & 


we obtain the standard diffusion equation. 


F(x) = 


(3.10) 


n 


/(?) = E a% - &•)• 

i— 1 


(3.11) 


T(x) — F xx (x). 


(3.12) 


j) and (3.8) yield 


n 


E at(i„ - f.) = 0 

t = l 


n 


Y A T x {x 0 — &) = o 
i=i 


(3.13) 


(3.14) 


Ef-i A,T xx (x 0 - ft ) 
zEjAi A^T o {x 0 ft) 


> 0. 


(3.15) 


I'uct a counter example if we can solve the simultaneous equations 
and any positive 


n 


E A T{x 0 - ft) = 0. 

i— 1 

(3.16) 

n 

E AT x {x„ - ft) = 0. 

«=i 

(3.17) 
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£ jVT»,(*o - ft) =-* • 

i— 1 


(3.18) 


Y AT„{x 0 — ft) = 1- 

i =1 


We can write these as a matrix equation: 


T(x 0 - 
T x (x 0 - 
T xx (x 0 
To{x 0 ■ 


T(x 0 - 
T x {x 0 - 
T xx {_x 0 

Tcr{x 0 


(3.19) 


(3.20) 


Using Appendix (1) a necessary and sufficient condition for it to be impossible 
to solve tjhese equations for any values of x 0 , Ci-.-Cn is that theie exists a vectoi 
X = (X 1 ,X 2 ,X 3 : X 4 ) independent of x such that 


X] T(x) + ^ 2 T x {x) + X 3 T xx (x) -j- X 4 T a (x) — 0 


(3.21) 


and 


■Xs^ -f~ X 4 ^ 0 


Equation! (3.22) will be satisfied for all positive i 2 if and only if 


^3^4 < 0 


(3.22) 


(3.23) 


Our boundary condition (2) means that F(x), and hence T{x), cannot depend on 
any scale lengt 1 . The X’s are independent of x and so to make (3.21) dimensionally 

correct (Bridgnan, 1922) we set 


Xi — —r, X 2 = —, X 3 — c, X 4 — 


(3.24) 


and rewrite it as 


a'T . bT x d 

_|-E Cl xx = -la 

a 2, o O 


(3.25) 


Condition (3.:! 3) implies that \ is positive. 

Now T = so F will also satisfy (3.25) although it is possible to add a term 
to F where -if = 0. However, this term will not satisfy the boundary condition 
( 5 ) as x •—► oo and so we discard it. 
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yhus, we have shown that we can always construct a counter example unless our 
filter F obeys o the equation 

a 4 + -F x + cF X x = -F c (3-26) 

a 2 a g 

with - positiv^. It is shown in Appendix (2) that the only solution of this equation 
obeying the b< undary conditions is the gaussian. Hence we obtain Theorem (1). 

4. The 2-D Case 

We now consider the two-dimensional case when the zero crossing operator is the 
laplacian V 2 a id the image depends oni = (x,y). Again, we consider the filtered 

image 

/ oo roo 

/ F{x - $)I{x)d£ (4.1) 

-oo J —oo 

We set 

E(x) = V 2 {F * I{x)} (4-2) 

The zero erasings are solutions of E{x) = 0 and form surfaces in the three- 
dimensional (r<r) space. Our requirements that zero crossings are not created at 
larger sc&les s’ satisfied if the extrema of these zero crossing surfaces are either 
maxima Or sa Idle points. Minima are forbidden. Thus, if we have a surface a(x,y) 
and there is; point (x 0 ,y 0 ) with 

&x{Xoi Vo) — &y(Xot Vo) 6 (4-3) 

we cannot ht ve a xy = 0 and both 

Oix > 0, Oyy > 0. (4-4) 

Let t be a p; rameter of a curve of the surface E{x) = 0. Then, 

dE _ dE dx dE dy OEda ^ 

dt dx dt dy dt do dt 

Since we are on the zero crossing surface, we have = 0 and setting t = x and 
then t y, ve obtain 

cr T = (4-6) 
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( 4 . 7 ) 


Suppose we a e at an extremum (x 0 ,y 0 ). Choose the x and y axes so that they 
coincide With lie directions of principal curvature at ( x 0 ,y 0 ). Then we calculate 


Gxx (^ 0 ) Vo) 


Gyy[Xoi yo) 


E X x{.X 0 yo) 
E a {x 0 , y 0 ) 

H'yyfao) yo) 
Fo{x 0) yo) 


(4.8) 


(4.9) 


It should be 
<r(:r, y) add 01 
curvature (thi 

As in the 1-D 
if E obeys tl 

positive^ (4.8) 
a gaussifm fill 

We now show 
The argtimen 


emphasized that (4.8) and (4.9) are true only at an extremum of 
ly if the x and y axes are taken along the directions of the lines of 
> ensures o xy = 0). 

case, it follows that the conditions (3) and (4) will always be satisfied 
e Diffusion Equation. Since if a xX {x 0 ,y 0 ) and a yy (x 0 ,y 0 ) are both 

and (4.9) imply that and are both negative. Thus, 

;r will always obey our condition. 

that if the filter is not a gaussian, we can construct a counter-example, 
is a generalization of die proof of Theorem 1. Let 


2 = 1 


(4.10) 


T(x) = V 2 F(x ) 


(4.11) 


We can cons met a counter-example if we can solve the matrix equation for any 
x 0 ,Ci- • j,Cn at d any positive i\ and t\: 


T(x 0 Cl) • * • 

T(x 0 - 

~ Cn) 

H - 

IT 

O 

1 

H-*- 

T x (x 0 - 

" Cn) 

IT 

o 

i 

Ty(X 0 - 

~ Cn) 

x{xq Ci) • • * 

T^yxx{Xo 

Cn) 

TT 

o 

1 

h-* 

Tyy[x 0 ■ 

Cn) 

la{Xo Cl) • * * 

T a {x 0 - 

— Cn) 


(4.12) 


Using Zipper dix (1), a necessary and sufficient condition for no solution to exist 
for all x 0 , a, .., Cn is that we can find X = (X lf ..X 5 ) such that 


ki(x) E X 2 T,(x) ~E X 3 r y (x) ~E X4T ;ci (x) \$T yy f- \q 1 0 {x) 0 (4.13) 
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and 


— 1 \\$ — ^5 + ^6 7^ 0 (4*14) 

Equation (4.T) can be satisfied for all positive ^ and l\ if and only if: 

X 4 X 5 > 0, X 4 X 6 < 0. (4.15) 

Again, b( und try condition (2) implies the X’s are of form 

1 == -^,X 2 = b ”,X 3 = —,X 4 = ci,X 5 = c 2 ,X 6 = —— (4-16) 


and T sMisfie 


- 7T -| - -T X -|- -Ty -j- C\T X% “E C2 Tyy 


d -T 

a 


(4.17) 


with ci^e 

F will 
of bdunc 


It is shf 
condjtid 
additioif 
gaus^iai 
and W0 
filters: j 
with po 
upside-) 
Sections 
suggests 
of the j 
smalled 


tisfy 

ary 

wn 
s is 
1 as 

H 


tive 
own 
of \ 
g th 
rfac 
:ind ! 


and c\d > 0. 

(4.17) up to a term ip with V 2 t/> = 0, which we can discard because 
:ondition (5). 

n Appendix (2) that the only solution of (4.17) which obeys our 
the product of two one-dimensional gaussians. If we make the 
sumption of symmetry, we obtain a two-dimensional symmetric 
mce, the gaussian is the only filter which satisfied our condition, 
proven Theorem 2. There is an additional property of gaussian 
d zero-crossing surfaces in the x, y, a space cannot have saddle points 
mean curvature H . The result of this section forbids the existence of 
mountains (in the x, y, a plane) and also of upside-down volcanos, 
tie zero-crossings surfaces normal to the x,y plane may appear as 
it lines of zero-crossings are created. In fact, because of saddle points 
j, zeros can be traced continuously along the zero-crossing surface to 
mailer scales. 

5. Further results 


It is clelr th; t the methods of proof we have developed do not only apply to zero 
crossings. F< r example, consider the one-dimensional case and look for solutions 

of 


(F * /) 


(5.1) 


TTieSe corres )ond to maxima and minima of the filtered signal which we call peaks 
and trcbughs. If we set E = £(F * I) and duplicate the arguments of section (2), 


n 










we find Lha 

t ha\ 

peaks and ti 

■pugf 

More ge te 

olly. 

with the dif 

llisio 1 

will not be 

:;reat< 

operators <| 


In partituls 

: r, ir 

created by 

:mon 

involves cr 

oatioi 

increase^ 

:y a 

extremum 

:ioint 

derivative^ 

vani: 


We have tonsil 
directional deri 


The directions 


using thb iimr 
along th| grad 


where M = § 


The zero cro: 
that if we ha' 


j ng a gaussian filter is a necessary and sufficient condition for 
s not to be created. 

f L(x) is a differential operator in any dimension that commutes 
i equation, then solutions of 

L(F * I) — const 0**^) 

d if and only if the filter is gaussian. Zeros of all linear differential 
encompassed by Theorem 1. 

two dimensions, surfaces obeying £{F * T) = ° can only be 
■gaussian filter. Thus, ridges and ravines whose creation necessan y 
L of zeros along some direction, can only be created, as the scale 
non-gaussian filter. The argument, however, does not apply to 
5 (non degenerate critical points, such as peaks and pits, where all 

h simultaneously). 

6. Directional operator 

lered the two-dimensional case when our operator is the second 
-ative along the direction of the gradient in the filtered image. Let 

H(x) = J J F(x — i)I(l)di- t 6 - 1 ) 

operator is 

d = 9H_ . JL (6.2) 

dt \m\dxj dxj 

I dxi 1 

lation convention on the j indices. The second directional derivative 
ent is then 

d 2 H __ HjHjHjj ( 6 3 ) 

dt 2 HkHk 

U.._ J‘_h_ anc i we US e the summation convention. We set 

dxidxj 

E(x) = (6 - 4) 

:ings lie on the surface a(x,y), where E(x) — 0. Our condition is 
s a point ( x 0 , y 0 ) where 

a x {x o, Vo) = <Xy{x 0 , Vo) = 0 ( 6 - 5 ) 
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m 


we find 


where th 
We d^fii 


and write (6.1 


y axes are along the direction of the lines of curvature of the a(x, y) 
point, then it is impossible for both o xx and o yy to be negative, i.e., 


&xx{%Oi Ho) o, GyyiXoiVo) 0 (6*6) 

plicit Function Theorem to obtain 


£ 

II 

^ da 

H 

(6.7) 

~Ey 

( 6 . 8 ) 

te 


/ \ E xx (x 0 , y 0 ) 

0xx\Xo> Vo) = „ , 

E a (x 0 ,y ) 

(6.9) 

/ \ Eyy(x 0 , y 0 ) 

°„{*o,yo)- Eo{xo y<>) 

(6.10) 

at if E obeys the Diffusion Equation, then the conditions (6.5) and 
s satisfied. However, E is no longer a linear function of the filter, 
not directly obtain a condition the filter must satisfy. Now set 

.1 

ii 

2 
—< 

(6.11) 

HiHjHij = A a ApA 1 Fi(a)Fj(0)Fij('i) 

(6.12) 

itnation convention applies to a, /?, 7 as well as to i, j. 


h = 

+ F t (a)FAl)Fv(P) + 

+ F^F^FijiD) + F^F^mM) 

(6.13) 

!) as 


HiHjHij = T(af>j)A a ApA^ 

(6.14) 
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We can wpduJe a counter-example if we can satisfy 


It folk* 
such t 


WSf 
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XiT(a|/? 7 


but 


As in s 

T{<*p 7 ) 

Howevd 
that tpe 
Diffuse) 
solutip 
of 


ctionl 


if and lily i 


lies in 



roml 


+ 


T(a0 1 ) 

T x (a0~f) 

... \ 

• • • 

^ Aq Aft-Ay^ 



T y (a0'i) 

• • • 



0 

Tx X (apl) 

• • • 



-l\ 

T X y[OC07) 

• • • 

; 


-t\ 

1 / 

v To (a/ 37 ) 

... j 



(6.15) 


Appendix (2) that no solution exists if there is a X == (Xi, X 2 , X 3 , X 4 , X 5 ,X 6 ) 


xl \T x {aPi) + \^T y {aM) + UT xx (af3 7 ) 


+ X 5 T yy (a/?7) -p ^&Tcr[oi(3l) — 0 

(6.16) 


—^X 4 — ^2X5 “P X6 7^ 


(6.17) 


(3), we can use dimensional arguments to show this means that 
lisfifcs the generalized Diffusion Equation. 

sinJe we require solutions to (6.15) of specific form A a ApA 1 it is possible 
no solutions of (6.15) even if T(a/? 7 ) does not obey the generalized 
jation. To rule this out, we must show that it is possible to find a 
fm A a ApA 1 . From Appendix (2) it is possible to get a solution B ah 


fre sd 






• 

> 


0 

• 

• 


-*1 

• 

' 



\To(aPl)J 

V . ) 


V 1 / 


(6.18) 


the vector 


/ 0 \ 
0 
0 

\ 1 ) 


aced spanned by the 
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0 > 
0 
0 
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ml 


If 

one sol 


where, 
We i(io 


ngi 


V Ta{ap 1 )J 

e i — 1 to 6 . 

is symmetric in all indices a, /? and 7 and so there are N = 
ch vectors. They have only six components each and so they are not 
endent. There will be at least N — 6 linearly independent vectors 


Ll = 0 ’ p = 1 to iV - 6 - 

apt 


(6.19) 


mil ft 


not obey the generalized Diffusion Equation theie will be at least 
a/3l to (6.18). The general solution is of form 


TV—6 
P= 1 

itrary. 

nder what conditions can we find A a and /x which satisfy 


( 6 . 20 ) 


TV—6 

Ba/ 3 7 + MpCa/37 




( 6 . 21 ) 
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example, Hen 


necessarv an 
vectors ,/iich 
dimensicnal s] 

Let tlje five \ 
solve (6.2 1) ar 


These ai 

a S] 

n Sllflfici 

ntly 

Thus, u 

'less 

possible 

to cc 

We itov* 

shov 

First su| 

pose 


where r}i is a 
Then w■; find 


Gij{ 


So we obtai 


t of (6.15) it is clear that scaling the A’s will not affect the counter- 
:e, satisfying (6.21) is equivalent to finding an A a such that A a ApA 7 
5 dimensional vector space spanned by B a p v A 

sufficient condition is that A a ApA 1 is perpendicular to the five 
span the complement of this N-5 dimensional space in the full N 
»ace. 

ectors be P a p 1 ,Qap^,T a p 1 ,X a p 1 and Y ah . It will be possible to 
d hence (6.15) if we can satisfy 

Pa/3 r y-A-OL ApAsy 0 
Q aP^AdApAry 0 

Tap^AaApA^ = 0 . ( 6 . 22 ) 

■YaP^Acx Ap Asy 0 

Y a p^A a ApAq — 0 . 

stem of five simultaneous cubic equations in n variables. If we take 
arge, it will always be possible to solve them (Yuille, in preparation). 

P(a/? 7 ) obeys the generalized Diffusion Equation, it will always be 
nstruct a counter-example. 

that no reasonable filter will satisfy these requirements, 
we have a gaussian filter G(x, a) 

G ^ a )=j^ ex ^-^ ( 6 - 23 ) 

i arbitrary number. 
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2a 2 2a 2 2a 2 

*;g{-(l-feHl-&)-(*-£) h) •(*“&) 

fa) 2 (s— £s) , , , (£ — £») 2 ( £ — <a) 

—— • [x - ?-,) i-“2 


4 


1 stitjte (6.26) into (6.27) we see that c{T xx + c 2 T yy contains a term 


All othei terrt 

Lp) and I £ 

for Z to be 

Now suflposf 
and integrate 


ii 


Hence, 


This w 
equatic 

genera 


We have 


with 


still 


in foil 
zed 


{■ 


(a - fa) 2 (£ - ») 2 o - £i) : 


) 


(a — (p) 


cr 

\2 


c — ?/3) 2 (a — £a) 


(a - £r)| 


(6.26) 


appendix (2), the general Diffusion Equation can be written 


f-i 


i >2 


d 


— T X + ~Ty + C\T X % + C 2 Tyy = ~T 0 


(6.27) 


-2 ^ C -Xrv - eip {— , 

0-3m+6 1 2cr 2 


($-fJ 2 (*-*>)* 


2<t 2 


2 a 2 


} 


(6.28) 


s in (6.27) will be of this form multiplied by powers of {x — Q, (x — 
). From (6.17), c x and c 2 have the same sign and so it is impossible 
^ro and, hence, (6.27) cannot be satisfied if the filter is a gaussian. 

we have a filter which satisfies this requirement. Set ^ 

T{a(5i) with respect to £ q and We find 




■A 


k(z [- i a )Fj{x - i p )FiM +(£ a + ip)) d i a % - Ft * F > * Ftj ^ ^ 6 ‘ 29 ^ 


£, = £« + £/>’ We ^ 


11 T[api)di a dlp = * F tJ (3x) 


(6.30) 


satisfy the generalized Diffusion Equation since T{af3 7 ) obeys this 
all values of £ a ,^ and From Appendix (2), the solution to the 

bi{fusion Equation is P * /(x), where / is an arbitrary function and 


-Pfe 


1 , (iT ha) d , f [y + ^ 2 ^) 2 d x 

,a)= ^exp{-^H-}exp { -“> 


2«7 2 C 2 


(6.31) 
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So a IT 
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apprd> 
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Fi * F, * Fij{ 3$) = P * f(x) (6.32) 

condition (4) means that fq = 6 2 = 0 and we can scale the x and 
: P a gaussian. Thus 

Fi * Fj * F^i 3s) = G * /(*) (6.33) 

msform this equation denoting the fourier transform of a function 

T Fiiw)T Fjiid)T FijiiF) = TG(3w)T/(3ui) (6.34) 

TFii ul) = -iwiTFiw) (6.35) 

TG(3cj) = exp{ 2^2 > ( 6 ‘ 36 ) 

_q, ,2 

W 4 {TF(a;)} 3 = exp{-^-}Tf(3ui) (6.37) 

T F{oj) = [HM}hxp { (6.38) 


convolution of a function with a gaussian and obeys the Diffusion 
t, as shown in Appendix 2, the only such filter which satisfies the 
iitions is a gaussian. 

:h obeys the conditions (6.16) and (6.17) must be a gaussian, and yet 
not satisfy these conditions. Therefore, for this directional operator, 
e to satisfy our requirement. Notice that if the gradient direction 
IQ rapidly the second directional derivative along the gradient can be 
by the second derivative along the x axis, where the x axis is chosen 
m of the gradient. 'The arguments of section 5 then show that no 
are created if, and only if, the filter is gaussian. If these assumptions 
t one scale, they may break down at larger scales because of the 
ither parts of the image. We therefore expect that at large scales 


18 


















* 111 j 


may be created even for gaussian filters, unless the image is very 
tance an isolated straight step-edge). 

7. Conclusions 


of the zero- (or level-) crossings is more complex in two dimensions 
imension. in the 2-D case, two zero crossing contours can merge 
id contour as the scale increases. The zero-crossing surface has 
onal crossection (for given y, say) that corresponds to an allowed 
ial case. In 2-D, however, the “complementary” situation can also 
d zero-crossing contour can split into two as the scale increases, just 
)f a tree may split into two branches. This occurs at saddle points 
3 ssing surface. This case would correspond in 1-D to the “creation” 
sing (imagine a one-dimensional section of the zero-crossing surface) 
idden. In 2-D, however, no new zero crossing is created, since the 
l surface is continuous down to zero scale. We have constructed 
ial examples of both these two cases, using the gaussian filters. Both 
ild also work for all other filters. 

functions have been proposed for filtering images. We expect that 
i a nice scaling behavior for values of a for which they approximate 
f the diffusion equation. The DOG (difference of gaussians) does not 
Fusion equation, but is a good approximation except when a is very 
limensional real Gabor functions (the product of a gaussian and a 
ne) approximate the solution of the diffusion equation only for large 
Our conditions are violated even more by the sine function which 
the diffusion equation at best in a weak asymptotic sense. Figure 
xample of the zero-crossings generated by the gaussian and the sine 


ng that our proof implies that the difference equation is the only 
in that has, with suitable boundary conditions, a nice scaling behavior 
is. This may have some implications in physics. 

we have shown that the gaussian is the only filter that guarantees a 
•ehavior of the zero- and level-crossings of linear differential operators, 
the gaussian need not be symmetric: elongated directional filters, 
stretching the axes, also have a nice scaling behaviour. We are 
dying the practical use of the scaling diagrams (in 2-D) for a symbolic 
n of images, as suggested by Witkin, and, in particular, for solving the 
ice problem in stereo. In this context, the robustness of the “scaling 
n” under small perturbations of the image is clearly critical and has 
ly studied. 





















a 


OUT res:l nin:0 na«: 



Figure 3 Examples of the zero-crossings of the secoi 
(a) and of the sine filter (b) for the same input functi 
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We can 
terms 


We wri 


where f 
(3) and 


art 


iary Jnd sufficient condition for a solution is that 


hece 

in 
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emot 




O), 0 | is the Fourier transform of F(x,a) with respect to x. Combining 
(2) v|e obtain 


fil 


atrix equation 


Bx — a 


(i) 


( &H ... bi n 

. 

bml • ^ mn' 


( bn .. • b\ n a l 

. 

bml ‘ • • b m n a m' 


( 2 ) 


sary and sufficient condition for the non-existence of a solution is 
d a vector X = (Xi,..X m ), such that 


Xi(bn,..., bi n ) -b ...-b X m (6 m i,.. •j b m n) — 0 


(3) 


Xifli ~b • • • ~b Xm fl m 7^ 


Appendix 2 


(4) 


ave a generalized Diffusion Equation of form 


F bF x , „ _ dF a 

ol—k H-b °Fxx — 

a 1 a (x 


(i) 


e the first term by the scaling F a-^F. Consider the remaining 


bFx , _ dF„ 

-b cF xx — 


( 2 ) 


a 


F(x,a) — [ f(u,a)e 

\[2tk 


-tux 


duj 


(3) 


b(—ioj) 


a 


/ + c(-w J )/ 


ddf_ 
a da 


(4) 
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nd get 


2 2 

— iuiba —cut a 


, . / \ f - iUJ UV - u u/ w _ 

f(uj,(T) = g(o;){e d e d 2 } 


a function of integration independent of o. 
uting (5) into (3) gives us 

F{x,c) = — / 9 (w){e =i ^e = ^^}e—’ "*rfu (6) 

>/2w 

.re considering equations for which c/d is positive and so the integral 
.. We now apply the convolution theorem to (6) and get 

F(x, o ) == —— [ \(x — f, <r)/i(f)df (7) 

V^r 

the fourier transform of g(u;) and X(x,cr) is tlie fourier transform of 
2d it. We calculate 


i llllTUl 


X(i, er) 


genlral solution to (1) is of form 


4(*+6a) s 


F(x,cr) 






/x(f)df 


rar r 


*. MUM 


Write 


and corjs 


se the boundary conditions stated in section (1). First, note that 
issian with centre x = —bo. The requirement that the centre of tlie 
move implies that b — 0. 


F(x,o) — o* f 

J ,/oT V co 


where <5 
will eitl 
Moreve 


' >/27T ' c 0 

he limit as a tends to 0. Now, 




( 10 ) 


Lirrio^o ——— ^ — 6(x — f) 

v^ Vcor 


( 11 ) 


tes the Dirac delta function. If (g) is non-zero the limits of F(x,o) 
undefined or zero. Hence our boundary condition (3) forces a — 0. 
tituting into (10) we obtain 
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condilic 


This a 
Equatii 


n (3) means that y(x) must be the delta function. Hence, on 
vis back into (10) the only solutions of (1) which satisfies our boundary 
he gaussian 


G( x, a) — 


s/2T^ ca 


a 1 -Axi 
- 


(13) 


A simijj 
in a tw 


We use 


We cai 


and 


respectl 


can be extended to the two dimensional generalized Diffusion 


aF b,F r b * F y 

~y H- ; -1-h ClF XX + CiFyy 


(14) 


|! 


iment shows that the only solution obeying the boundary condition 
:nsional space is 


G{x,y,a) 


1 d d 1 — d x 2 —d V 2 

- «/ — 4 /--e 2c i ° 2 e^2 <t ? 


sfzi v Cl v c 2 a' 


(15) 




mmetry requirement of section (1) to set c\ = c 2 . Then we obtain 


. I d l -d (x 2 -fy 2 ) 

G{x,y,a) = - -2 e2c " 2 

2n c 

scale the cr-axis by and write (13) and (16) as 

G(x,a) — — — e~*° T 
s/ZK* 


(16) 


(17) 


^ 1 r.(t.. 2 +v 2 ) 

G{x,y,a) = 

27r a 1 

:\y. This ensures that a is the standard deviation of the function. 


(18) 
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